What is Shannon information?

نویسندگان

  • Olimpia Lombardi
  • Federico Holik
  • Leonardo Vanni
چکیده

entity; it is always tied to a physical representation. It is represented by engraving on a stone tablet, a spin, a charge, a hole in a punched card, a mark on a paper, or some other equivalent.” (1996, p. 188; see also Landauer 1991). This view is also adopted by some philosophers of science; for instance, Peter Kosso states that “information is transferred between states through interaction.” (1989, p. 37). The need of a carrier signal sounds natural in the light of the generic idea that physical influences can only be transferred through interactions. On this basis, information is conceived by many physicists as a physical entity with the same ontological status as energy; it has also been claimed that its essential property is the power to manifest itself as structure when added to matter (Stonier 1990, 1996). As we argued above, pace Timpson, the abstract nature of information is not an obstacle to a physical interpretation of the concept. Nevertheless, it might be thought that the neutrality of Shannon information with respect to the physical theory −or theories− involved in the implementation of the communication arrangement is really a trouble for the physical interpretation. However, this conclusion is not unavoidable. In fact, many physical concepts, through the evolution of the discipline, have experienced a process of abstraction and generalization in such a way that, at present, they are no longer tied to a specific theory but permeate the whole of physics. Again, energy is the most conspicuous example: since essentially present in all the theories of physics, it is not tied to one in particular; it has different physical manifestations in different domains; nevertheless, the concept of energy is perhaps the physical concept par excellence. Mutatis mutandis, the same can be said of information, and therefore its theoretical neutrality is not an insurmountable obstacle to interpret the concept in physical terms. The difference between the epistemic and the physical interpretations of information is not merely nominal, but may yield different conclusions regarding certain common physical situations. For instance, in the influential philosophical tradition that explains scientific observation in terms of information (Shapere 1982, Brown 1987, Kosso 1989), the way in which information is conceived leads to very different consequences regarding observation. This turns out to be particularly clear in the so-called ‘negative experiments’ (see Jammer 1974), in which it is assumed that an object or event has been observed by noting the absence of some other object or event. From the informational view of scientific observation, observation without a direct physical interaction between the observed object and an appropriate destination is only

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A New Model for Best Customer Segment Selection Using Fuzzy TOPSIS Based on Shannon Entropy

In today’s competitive market, for a business firm to win higher profit among its rivals, it is of necessity to evaluate, and rank its potential customer segments to improve its Customer Relationship Management (CRM). This brings the importance of having more efficient decision making methods considering the current fast growing information era. These decisions usually involve several criteria,...

متن کامل

Some Results Based on Entropy Properties of Progressive Type-II Censored Data

In many life-testing and reliability studies, the experimenter might not always obtain complete information on failure times for all experimental units. One of the most common censoring schemes is progressive type-II censoring. The aim of this paper is characterizing the parent distributions based on Shannon entropy of progressive type-II censored order statistics. It is shown that the equality...

متن کامل

CS 798: Theory of Quantum Information

1.2 REMARK ON INTERPRETATIONS OF THE SHANNON ENTROPY There are standard ways to interpret the Shannon entropy. For instance, the quantity H(p) can be viewed as a measure of the amount of uncertainty in a random experiment described by the probability mass function p, or as a measure of the amount of information one gains by learning the value of such an experiment. Indeed, it is possible to sta...

متن کامل

Towards Quantifying a Wider Reality: Shannon Exonerata

In 1872 Ludwig von Boltzmann derived a statistical formula to represent the entropy (an apophasis) of a highly simplistic system. In 1948 Claude Shannon independently formulated the same expression to capture the positivist essence of information. Such contradictory thrusts engendered decades of ambiguity concerning exactly what is conveyed by the expression. Resolution of widespread confusion ...

متن کامل

Information Gathering in Bayesian Networks

The optimal design of data acquisition is not obvious in Bayesian Network models. The dependency structure may vary dramatically, which makes learning and information evaluation complicated and sometimes non-intuitive. Our application, and the motivation for working on this topic, is prospect selection for petroleum exploration in the North Sea. Here, the data gathering is often carried out dur...

متن کامل

A New Interpretation of the Shannon Entropy Measure

Although more than sixty years have elapsed since Shannon's seminal information entropy paper the literature reveals that there are divergent opinions of what it actually measures. From its similarity to Boltzmann entropy in statistical mechanics, the most common view is that it measures information disorder and uncertainty. Based on an inductive derivation of the expression we propose a new in...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Synthese

دوره 193  شماره 

صفحات  -

تاریخ انتشار 2016